On-Line Algorithms for Neural Networks with IIR Synapses

نویسندگان

  • P. Campolucci
  • Paolo Campolucci
  • Francesco Piazza
  • Aurelio Uncini
چکیده

This paper is focused on the learning algorithms for dynamic multilayer perceptron neural networks where each neuron synapsis is modelled by an infinite impulse response (IIR) filter (IIR MLP). In particular, the Backpropagation Through Time (BPTT) algorithm and its less demanding approximated on-line versions are considered. In fact it is known that the BPTT algorithm is not causal and therefore can be implemented only in batch mode, while many real problems require on-line adaptation. In this paper we give the complete BPTT formulation for the IIR MLP, derive an already known on-line learning algorithm as a particular approximation of the BPTT, and propose a new approximated algorithm. Several computer simulations of identification of dynamical systems will also be presented to assess the performance of the approximated algorithms and to compare the IIR MLP with more traditional dynamic networks.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On-line learning algorithms for neural networks with IIR synapses

This paper is focused on the learning algorithms for dynamic multilayer perceptron neural networks where each neuron synapsis is modelled by an infinite impulse response (IIR) filter (IIR MLP). In particular, the Backpropagation Through Time (BPTT) algorithm and its less demanding approximated on-line versions are considered. In fact it is known that the BPTT algorithm is not causal and therefo...

متن کامل

Intrinsic Stability-Control Method for Recursive Filters and Neural Networks

Linear recursive filters can be adapted on-line but with instability problems. Stability-control techniques exist, but they are either computationally expensive or nonrobust. For the nonlinear case, e.g., locally recurrent neural networks, the stability of infinite-impulse response (IIR) synapses is often a condition to be satisfied. This brief considers the known reparametrization-for-stabilit...

متن کامل

Casual BackPropagation Through Time for Locally Recurrent Neural Networks

This paper concerns dynamic neural networks for signal processing: architectural issues are considered but the paper focuses on learning algorithms that work on-line. Locally recurrent neural networks, namely MLP with IIR synapses and generalization of Local Feedback MultiLayered Networks (LF MLN), are compared to more traditional neural networks, i.e. static MLP with input and/or output buffer...

متن کامل

Causal Back Propagation through Time for Locally Recurrent Neural Networks

This paper concerns dynamic neural networks for signal processing: architectural issues are considered but the paper focuses on learning algorithms that work on-line. Locally recurrent neural networks, namely MLP with IIR synapses and generalization of Local Feedback MultiLayered Networks (LF MLN), are compared to more traditional neural networks, i.e. static MLP with input and/or output buffer...

متن کامل

Intrinsically stable IIR filters and IIR-MLP neural networks for signal processing

The capabilities of Locally Recurrent Neural Networks (LRNNs) in performing on-line Signal Processing (SP) tasks are well known [1,3,5,6,10,11,14,15]. In particular one of the most popular architecture is the Multi Layer Perceptron (MLP) with linear IIR temporal filter synapses (IIR-MLP) [3,5,10,11,14,15]. IIR-MLP is theoretically motivated as a non-linear generalization of linear adaptive IIR ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1995